AudioViewer: Learning to Visualize Sounds

A long-standing goal in the field of sensory substitution is to enable sound perception for deaf and hard of hearing (DHH) people by visualizing audio content. Different from existing models that translate to hand sign language, between speech and text, or text and images, we target immediate and low-level audio to video translation that applies to generic environment sounds as well as human speech. Since such a substitution is artificial, without labels for supervised learning, our core contribution is to build a mapping from audio to video that learns from unpaired examples via high-level constraints. For speech, we additionally disentangle content from style, such as gender and dialect. Qualitative and quantitative results, including a human study, demonstrate that our unpaired translation approach maintains important audio features in the generated video and that videos of faces and numbers are well suited for visualizing high-dimensional audio features that can be parsed by humans to match and distinguish between sounds and words. Code and models are available at https://chunjinsong.github.io/audioviewe

Next Steps for Human-Centered Generative AI: A Technical Perspective

Through iterative, cross-disciplinary discussions, we define and propose next-steps for Human-centered Generative AI (HGAI) from a technical perspective. We contribute a roadmap that lays out future directions of Generative AI spanning three levels: Aligning with human values; Accommodating humans' expression of intents; and Augmenting humans' abilities in a collaborative workflow. This roadmap intends to draw interdisciplinary research teams to a comprehensive list of emergent ideas in HGAI, identifying their interested topics while maintaining a coherent big picture of the future work landscape

Neonatal local noxious insult affects gene expression in the spinal dorsal horn of adult rats

Neonatal noxious insult produces a long-term effect on pain processing in adults. Rats subjected to carrageenan (CAR) injection in one hindpaw within the sensitive period develop bilateral hypoalgesia as adults. In the same rats, inflammation of the hindpaw, which was the site of the neonatal injury, induces a localized enhanced hyperalgesia limited to this paw. To gain an insight into the long-term molecular changes involved in the above-described long-term nociceptive effects of neonatal noxious insult at the spinal level, we performed DNA microarray analysis (using microarrays containing oligo-probes for 205 genes encoding receptors and transporters for glutamate, GABA, and amine neurotransmitters, precursors and receptors for neuropeptides, and neurotrophins, cytokines and their receptors) to compare gene expression profiles in the lumbar spinal dorsal horn (LDH) of adult (P60) male rats that received neonatal CAR treatment within (at postnatal day 3; P3) and outside (at postnatal 12; P12) of the sensitive period. The data were obtained both without inflammation (at baseline) and during complete Freund's adjuvant induced inflammation of the neonatally injured paw. The observed changes were verified by real-time RT-PCR. This study revealed significant basal and inflammation-associated aberrations in the expression of multiple genes in the LDH of adult animals receiving CAR injection at P3 as compared to their expression levels in the LDH of animals receiving either no injections or CAR injection at P12. In particular, at baseline, twelve genes (representing GABA, serotonin, adenosine, neuropeptide Y, cholecystokinin, opioid, tachykinin and interleukin systems) were up-regulated in the bilateral LDH of the former animals. The baseline condition in these animals was also characterized by up-regulation of seven genes (encoding members of GABA, cholecystokinin, histamine, serotonin, and neurotensin systems) in the LDH ipsilateral to the neonatally-injured paw. The largest aberration in gene expression, however, was observed during inflammation of the neonatally injured hindpaws in the ipsilateral LDH, which included thirty-six genes (encoding numerous members of glutamate, serotonin, GABA, calcitonin gene-related peptide, neurotrophin, and interleukin systems). These findings suggest that changes in gene expression may be involved in the long-term nociceptive effects of neonatal noxious insult at the spinal level

Parton energy loss limits and shadowing in Drell-Yan dimuon production

A precise measurement of the ratios of the Drell-Yan cross section per nucleon for an 800 GeV/c proton beam incident on Be, Fe and W targets is reported. The behavior of the Drell-Yan ratios at small target parton momentum fraction is well described by an existing fit to the shadowing observed in deep-inelastic scattering. The cross section ratios as a function of the incident parton momentum fraction set tight limits on the energy loss of quarks passing through a cold nucleus

Measurement of Angular Distributions of Drell-Yan Dimuons in p+pp + p Interactions at 800 GeV/c

We report a measurement of the angular distributions of Drell-Yan dimuons produced using an 800 GeV/c proton beam on a hydrogen target. The polar and azimuthal angular distribution parameters have been extracted over the kinematic range $4.5 < m_{\mu \mu} < 15$ GeV/c$^2$ (excluding the $\Upsilon$ resonance region), $0 < p_T < 4$ GeV/c, and $0 < x_F < 0.8$. The $p+p$ angular distributions are similar to those of $p+d$, and both data sets are compared with models which attribute the $\cos 2 \phi$ distribution either to the presence of the transverse-momentum-dependent Boer-Mulders structure function $h_1^\perp$ or to QCD effects. The data indicate the presence of both mechanisms. The validity of the Lam-Tung relation in $p+p$ Drell-Yan is also tested.Comment: 4 pages, 3 figure

Measurement of Angular Distributions of Drell-Yan Dimuons in p + d Interaction at 800 GeV/c

We report a measurement of the angular distributions of Drell-Yan dimuons produced using an 800 GeV/c proton beam on a deuterium target. The muon angular distributions in polar angle $\theta$ and azimuthal angle $\phi$ have been measured over the kinematic range $4.5 < m_{\mu \mu} < 15$ GeV/c$^2$, $0 < p_T < 4$ GeV/c, and $0 < x_F < 0.8$. No significant cos$2\phi$ dependence is found in these proton-induced Drell-Yan data, in contrast to the situation for pion-induced Drell-Yan. The data are compared with expectations from models which attribute the cos$2\phi$ distribution to a QCD vacuum effect or to the presence of the transverse-momentum-dependent Boer-Mulders structure function $h_1^\perp$. Constraints on the magnitude of the sea-quark $h_1^\perp$ structure functions are obtained.Comment: 4 pages, 3 figure